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ABSTRACT 


A  single  cell  theory  for  the  development  of  selectivity  and  ocular  dominance  in  visual  cortex 
has  been  generalized  to  incorporate  more  realistic  neural  networks  that  approximate  the 
actual  anatomy  of  small  regions  of  cortex.  In  particular  we  have  analyzed  a  network 
consisting  of  excitatory  and  inhibitory  cells,  both  of  which  may  receive  infonmation  from 
LGN  and  then  interact  through  cortico-cortical  synapses  in  a  mean  field  approximation.  Our 
investigation  of  the  evolution  of  a  cell  in  this  mean  field  network  indicates  that  many  of  the 
results  on  existence  and  stability  of  fixed  points  that  have  been  obtained  previously  in  the 
single  cell  theory  can  be  successfully  generalized  here.  We  can,  in  addition,  make  explicit 
further  statements  concerning  the  independent  effects  of  excitatory  and  inhibitory  neurons 
on  selectivity  and  ocular  dominance.  For  example,  shutting  off  inhibitory  cells  lessens 
selectivity  and  alters  ocular  dominance,  (masked  synapses).  These  inhibitory  cells  may  be 
selective  but  there  is  no  theoretical  necessity  that  they  be  so.  Further  the  intracortical 
inhibitory  synapses  do  not  have  to  be  very  responsive  to  visual  experience.  Most  of  the 
learning  process  can  occur  among  the  excitatory  LGN-cortical  synapses.  Some  of  these 
ideas  are  compared  with  experimental  results. 


Introduction 


A  single  cell  theory  for  the  development  of  selectivity  and  ocular  dominance  in  visual  cortex 
has  been  presented  previously  by  Bienenstock,  Cooper  and  Munro  (BCM)  (1).  This  has 
been  extended  to  a  network  applicable  to  layer  4  of  visual  cortex  (2).  In  this  paper  we 
present  a  mean  field  approximation  that  captures  in  a  fairly  transparent  manner  the 
qualitative,  and  many  of  the  quantitative,  results  of  the  network  theory. 

Visual  cortex  has  been  extensively  investigated  (3,4).  We  summarize  some  of  the 
dominating  experimental  facts  very  briefly.  Neurons'in  the  primary  visual  cortex  of 
normal  adult  cats  are  sharply  tuned  for  the  orientation  of  an  elongated  slit  of  light  and  most 
are  activated  by  stimulation  of  either  eye.  Both  of  these  properties-orientation  selectivity 
and  binocularity-depend  on  the  type  of  visual  environment  experienced  during  a  critical 
period  of  early  postnatal  development  extending  from  approximately  3  weeks  to  3  months. 
For  example,  deprivation  of  patterned  input  during  this  critical  period  leads  to  loss  of 
orientation  selectivity  while  monocular  deprivation  (MD)  results  in  a  dramatic  shift  in  the 
ocular  dominance  of  cortical  neurons  such  that  most  will  be  responsive  exclusively  to  the 
open  eye  .  The  ocular  dominance  shift  after  MD  is  the  best  known  and  most  intensively 
studied  type  of  visual  conical  plasticity.  The  consequences  of  binocular  deprivation  (.BD) 
on  visual  cortex  stand  in  striking  contrast  to  those  observed  after  MD.  While  7  days  of  MD 
during  the  second  postnatal  month  leave  few  neurons  in  striate  cortex  responsive  to 
stimulation  of  the  deprived  eye,  most  cells  remain  responsive  to  visual  stimulation  through 
either  eye  after  a  comparable  period  of  BD.  However,  prolonged  periods  of  BD  lead  to  a 
loss  of  orientation  selectivity,  an  effect  not  observed  in  the  response  to  the  open  eye  after 
comparable  periods  of  MD.  The  theory  we  discuss  is  concerned  primarily  with  the 
explanation  of  these  and  related  facts. 

Definitions  and  Notation 

We  focus  attention  on  the  input  from  LGN  and  intercortical  interactions.  Input  trom  other 
regions  of  cortex  are  considered  part  of  a  background  excitation  or  inhibition  contributing 
to  the  spontaneous  activity  of  the  cell.  In  addition,  the  various  time  delays  that  result  in 
structure  in  the  post  stimulus  time  histogram  are  assumed  to  be  integrated  over  periods  of 
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the  order  of  a  second  for  purposes  of  synapuc  modification.  This  leads  to  a  circuit  as 
shown  in  Fig.  1. 


The  output  of  the  cells  of  the  full  network  can  be  written 

c  =  c*(Md  +  Lc),  [1] 

where  c*  is  a  sigmoidal  response  function, 

c  =  (cj  ...  cn)t,  [2a] 

cl  is  the  output  firing  rate  of  the  i1*1  cortical  cell  and 

A/  =  (  mL>  K  ),  [2b] 

where  and  are  the  s^  LGN  'synapses'  from  the  left  and  right  eye  to  the  fh 
cortical  cell. 

d  =  (d1,  dr)T  and  dI>r  =  (d'{r)  ...  d'n(r))T  [2c] 

are  the  time  averaged  inputs  from  the  left  and  right  eye  as  described  in  BCM, 

L  =  (Ljj)  [2d] 

is  the  matrix  of  cortico-cortical  synapses  and  LtJ  is  the  synapse  from  the  jth  cell  to  the  ith  cell. 
(Notice  that  italicized  symbols  always  contain  left  and  right  eye  components.) 

In  the  monotonically  increasing  region  above  threshold  and  Ixtiow  saturation,  in  a  iinear 
approximation. 


M 


» 


c  =  Md  +  Lc. 
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We  consider  a  region  of  cortex  for  which  the  neural  mapping  of  the  input  from  the  visual 
field  is  constant  (all  of  the  cells,  in  effect,  look  at  a  given  region  of  the  visual  field.)  Under 
these  conditions,  for  an  input,  d  ,  constant  in  time,  the  equilibrium  state  of  the  network 
would  be 

c  =  (\-LyxMd.  [4] 

Equilibrium  as  well  as  non-equilibrium  information  may  be  critical  to  the  evolution  of  the 
network  as  well  as  of  primary  importance  in  information  processing.* 

Mean  Field  Approximation 

For  a  given  LGN-cortical  vector  of  synapses,  mv  (the  i^1  row  of  M)  and  for  a  given  input 
from  both  eyes,  d,  Eq.  3  for  the  firing  rate  of  the  i^1  conical  cell  becomes 

Cj  =  m,d  +Z  Ljj  cjt  [5] 

where  the  first  term  is  due  to  the  input  from  LGN  and  the  second  due  to  input  from  other 
cortical  cells.  We  define  c  as  the  spatially  averaged  firing  rate  of  all  of  the  cortical  cells  in 
the  region  defined  above: 

e  =  (l/N)Zci.  [6] 

i 

The  mean  field  approximation  is  obtained  by  replacing  cj  in  the  sum  in  Eq.  5  by  its  average 
value  so  that  c;  becomes 

c,  =  mxd  +  c  I  Ljj.  [7] 

j 

Here,  in  a  manner  similar  to  that  in  the  theory'  of  magnetism,  we  have  replaced  the  effect  of 
individual  conical  cells  by  their  average  effect  (as  though  all  other  conical  cells  can  be 
replaced  by  an  effective'  cell).  It  follows  that 

c  =  tnd  +  cl.G  =  (1-1())  1  riid,  [7a] 


where 


4. 


w=(l/N)  I/Hj  [81 

i 

and 

L  =(l/N)ZLij, 
u  y 

so  that 

Ci  =  (mi  +  (  (Z  Lij )  /  0-^) 

If  we  assume  that  the  lateral  connection  strengths  are  a  function  only  of  i-j  (not  dependent 
on  the  absolute  position  of  a  cell  in  the  network,  therefore  dependent  only  on  the  distance 
of  two  cells  from  one  another),  becomes  a  circular  matrix  so  that 

ZLjj  =  Z  Lji  =  L0  =  constant  [9] 

i  J 

and 

c-Cm.  +  CVd-Lo))/^.  [10] 

In  the  mean  field  approximation  we  can  therefore  write 

c;  (Ct)=  (m  i  -  a  )d  =  (m\  *  a'H1  +  (mr;  -  ar)-dr,  [11] 

where  the  mean  field 

a  =  (a1,  ar)  =  -a  (rii1 ,  rhr)  [12] 

with 

a  =  IL0l(l+IL0l)-l,  [12a] 

and  we  asume  that  L0  <  0  ( the  network  is,  on  average,  inhibitory).'*' 

The  Cortical  Network 

The  behavior  of  visual  cortical  cells  in  various  rearing  conditions  suggests  that  some  cells 
respond  more  rapidly  to  environmental  changes  than  others.  In  monocular  deprivation 
(MD),  for  example,  some  cells  remain  responsive  to  the  closed  eye  in  spite  of  the  very  large 
shift  of  most  cells  to  the  open  eye.  Singer  (6)  found,  using  intracellular  recording,  that 
geniculo-cortical  synapses  on  inhibitory  interneurons  are  more  resistant  to  monocular 
deprivation  than  are  synapses  on  pyramidal  cel!  dendrites.  In  dark  rearing  some  cells 
become  non-responsive  to  visual  stimuli  while  most  cells  retain  some  responsiveness  (1). 


Recent  work  suggests  that  the  density  of  inhibitory  GABAergic  synapses  in  kitten  striate 
cortex  is  also  unaffected  by  MD  during  the  critical  period  (7,8). 

These  results  suggest  that  some  LGN-cortical  synapses  modify  rapidly,  while  others 
modify  relatively  slowly,  with  slow  modification  of  some  cortico-cortical  synapses. 
Excitatory  LGN-cortical  synapses  onto  excitatory  cells  may  be  those  that  modify  primarily. 
(Since  these  synapses  are  formed  exclusively  on  dendritic  spines,  this  raises  the  possibility 
that  the  mechanisms  underlying  synaptic  modification  exist  primarily  in  axo-spinous 
synapses.)  To  embody  these  facts  we  introduce  two  types  of  LGN-cortical  synapses: 
those  ( m\ )  that  modify  (according  to  the  modification  rule  discussed  in  BCM  )  and  those 
(zk)  that  remain  relatively  constant.  In  a  simple  limit  we  have 

mi  =  <KCi,Ci)rf 

and  [13] 

4  =  0. 

(In  what  follows  c  denotes  the  spatial  average  over  cortical  cells,  while  c;  denotes  the  time 
averaged  activity  of  the  ith  cortical  cell).  The  function  $  is  discussed  in  BCM.  We  assume 
for  simplicity,  and  consistent  with  the  above  physiological  interpretation,  that  these  two 
types  of  synapses  are  confined  to  two  different  classes  of  cells  and  that  both  left  and  right 
eye  have  similar  synapses  (both  m  ,  or  both  z* )  on  a  given  cell.  We  therefore  can  write 

Cj  =  mxd  +  X  L,j  Cj 

and  [14] 

Ck  =  Zyd  +  X  Lkj  Cj. 

j  J 

Further,  in  what  follows,  we  assume  for  maximum  simplicity  that  there  is  no  modification 
of  cortico-cortical  synapses  although  what  experimental  results  there  are  suggest  only  that 
modification  of  inhibitory  cortico-cortical  synapses  is  slow  (7,8).  The  consequences  of  a 
theory  including  cortico-cortical  synapse  modification  for  the  full  network  was  briefly 
discussed  in  BCM  (1)  and  will  be  discussed  more  fully  in  the  mean  field  approximation 
elsewhere. 


In  a  cortical  network  with  modifiable  and  non-modifiable  LGN-cortical  synapses  and  non- 
modifiable  cortico-cortical  synapses,  the  synaptic  evolution  equations  become 

m\  =  <j>(ci,ci  )d. 


4  =  0,  [15] 

and 

4  =  0. 

This  leads  to  a  very  complex  set  of  coupled  non-linear  stochastic  evolution  equations  that 
have  been  simulated  and  partially  analyzed  elsewhere  (2).  The  mean  field  approximation 
permits  dramatic  simplification  of  these  equations  leading  to  analytic  results  and  a  fairly 
transparent  understanding  of  their  consequences  in  various  conditions.  In  this 
approximation  Eqs.  14  become 

q  =  m\d  +  L0c 

and  [16] 

c  k  =  Zkd  +Lqc, 


so  that  we  can  now  write 


c,(a)  =  (mi  -  a  )d  -  (ml  -  a'Td1  +  (m1-  -  ar)-dr 


ck(a)  =  (zk  -  a)d  =  (zlk  -  a')-d>  +  (zrk  -  ar)  dr. 


where  now  a’T)  contain  terms  from  modifiable  and  non-modifiable  synapses: 

a'W  =  a  (m'h)  +  zKri), 

Nm 

m>(r)  =  N'1  Z  m1(r), 
i=  1  1 

^nm  , 

z’h)  =  N-i  Z  z!(r) 

k=  1  ^ 


and  a  is  defined  in  eq.  (12a). 
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(N=Nm  +  Nnm,  where  Nm  is  the  number  of  cells  with  modifiable  synapses  and  Nnrn  is  the 
number  of  cells  with  non-modifiable  synapses.)  Since  it  is  assumed  that  neither  L  nor  z 
change  as  the  network  evolves,  only  fil'd)  is  time  dependent. 

Position  and  Stability  of  Fixed  Points  of  LGN-Cortical 
Synapses  in  the  Mean  Field  Network 

We  now  generalize  the  arguments  given  in  BCM  and  Cooper,  Munro  and  Scofield  (9)  for 
the  position  and  stability  of  the  fixed  points  of  the  stochastic  non-linear  synaptic 
modification  equations.  In  the  mean  field  network 

rhi(a)  =  4>  (Cj(a),  cl  ( a))d  =  <j)  [m^a)  -  a]d  [19 

where  c ,(a)  is  defined  by  Eq.  17  and  q (a)  is  an  average  of  the  form 


:i(a)  =  x  J*_t00exp[(t*-t)x1  ]  q(a,t')  dt'. 


The  mean  field,  a'd)  as  given  by  Eq.  12,  has  a  time  dependent  component  ril'd).  This 
varies  as  die  average  over  all  of  the  network  modifiable  synapses  and,  in  most 
environmental  situations,  should  change  slowly  compared  to  the  change  of  the  modifiable 
synapses  to  a  single  cell: 

Idl'd)! « lm1(r)l.  [21 


We,  therefore,  define  an  adiabatic  approximation  in  which  we  assume  that  a  is  slowly 
varying  and  determine  the  trajectory  of  m\  for  fixed  a..  (We  imagine  that  mx  reaches  its 
fixed  point  before  a  varies.  The  non-adiabatic  situation  is  analyzed  in  the  appendix.  It  is 
shown  there  that,  in  any  case,  the  position  and  stability  of  the  fixed  points  are  unaltered.) 
In  the  adiabatic  approximation  we  can  write 


(nii(a)-a)  =  <)[/»,(«)-«]</. 


We  see  that  there  is  a  mapping 
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m\< — >  mi(a)  -  a  [23] 

such  that  for  every  m\(a)  there  exists  a  corresponding  (mapped)  point  m\  which  satisfies 

d,  [24] 

the  original  equation  for  the  mean  field  zero  theory.  Therefore,  if  we  start  from  the 
corresponding  initial  point 


mi'(to)  =  m,(a,to)  -  a , 


[25] 


the  mi  trajectory  viewed  from  the  mi  coordinate  system  is  the  trajectory  of  nii(a  =  0). 
Thus,  we  can  compute  mi(a)  from  the  a  =  0  trajectory  using 


mi(a)  =  mi  +  a  =  m,(a  =0)  +  a  . 


The  transformation 


mi"  =  tn-\  +  a 


[26] 

[27] 


gives  a  coordinate  system  whose  origin  is  displaced  from  the  mean  field  zero  coordinates 
by  a.  The  trajectory  of  a  solution  of  the  a  =  0  theory  measured  from  this  coordinate 
system  gives  a  solution  of  the  a  *  0  theory  for  the  corresponding  point: 

mi” (a)  =  mi  (a )  +  a  =  m;( 0)  +  a  =  m^a).  [28] 


It  follows  that  at  corresponding  points 

c,(rr)  =  c,(0) 

and  [29] 

c,(a)  =  Cj(0), 

so  that  the  modification  threshold,  0\|,  is  unaltered  in  this  mapping.*  Applied  to  the  fixed 
points  we  conclude  that  for  every  fixed  point  of  ;«i(a=0)  there  exists  a  corresponding  fixed 
point  for  m^a)  with  the  same  selectivity  and  stability  properties.  Therefore,  just  as  for  the 
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a  =0  theory,  for  arbitrary  a  only  selective  fixed  points  are  stable.  Further,  at 
corresponding  fixed  points  we  obtain  the  same  cell  output. 

From  this  we  see  that  if  the  background  inhibition  is  changed  (e.g.  by  long  term  application 
of  bicuculine  or  a  GABA  agonist)  and  the  LGN-cortical  synapses  are  allowed  to  evolve  to 
the  new  fixed  points  in  the  same  visual  environment,  the  outputs  of  the  cortical  cells  will 
evolve  to  what  they  were  before  the  background  inhibition  was  altered,  fit  is  presumed  that 
a  cortical  cell  does  not  jump  from  one  stable  fixed  point  to  another  in  this  process.] 

The  above  is  limited  as  follows: 

(1)  The  LGN-cortical  synapses  are  restricted  to  be  positive  (excitatory).  Therefore,  if  a  is 
too  small  (insufficient  background  inhibition),  m\(a)  will  not  be  able  to  reach  its  fixed 
points  with  only  positive  components. 

(2)  The  LGN-cortical  synapses  cannot  increase  beyond  some  physiological  and/or 
molecular  limit.  Therefore,  if  a  is  too  large,  the  cell  will  never  fire  thus  restricting  the 
evolution  of  m^a). 

Evolution  of  the  Mean  Field  Network  Under  Various  Rearing 
Conditions 

We  are  now  in  a  position  to  calculate  the  evolution  of  cortical  cells  under  various  rearing 
conditions.  In  what  follows  we  give  as  one  example  the  evolution  of  cortical  ceils  in  the 
mean  field  network  under  conditions  of  monocular  deprivation.  The  argument  is  similar  to 
that  given  in  BCM.  A  more  detailed  analysis  including  comparisons  with  experiment  will 
be  presented  elsewhere  (10). 

Under  conditions  of  monocular  deprivation,  the  animal  is  reared  with  one  eye  closed.  For 
the  sake  of  analysis  assume  that  the  right  eye  is  dosed  and  that  only  noise-like  signals 
arrive  at  cortex  from  the  right  eye.  Then  the  environment  of  the  cortical  cells  is: 


d  =  (di.  n)T. 


1 30 1 


Further,  assume  that  the  left  eye  synapses  have  reached  their  selective  fixed  point,  selective 
to  pattern  d1.  Then  (rr^1,  m|)  =  (m|*,  x;)  with  lx;l  «  lm|*l.  For  the  preferred  open  eye 

pattern  (d!,n)  we  have  c^a)  =  0M  +  (xr  ar)-n,  while  for  the  non-preferred  open  eye 
patterns  (di,  n),  j  >  1,  Cjfa)  =  (x;  -  ar)-n.  Following  the  argument  of  BCM,  a  time 
average  over  the  full  pattern  environment  gives 

Xj  = -k(x;  -  ocr)  with  ic  a  positive  number.  [31] 

For  a  constant  or  slowly  varying  mean  field  this  leads  to  an  asymptotic  solution  for  the 
fixed  point: 

x;  =  ar  =  a  (x  +  zr).  [32] 

We  see  that 

Xi’  (ar)  =  x;*  (0)  +  ar  =  ar,  [33] 

as  expected  from  the  above  general  argument.  If  we  now  include  the  self-consistency 
condition  that  is  a  consequence  of  the  variation  of  the  mean  field  and  using 

Nm 

x  =  (l/N)Ixi,  [34] 

1=1 

we  obtain 

X  =  Xa  (1  -  Xa)-1zr,  [35] 

where  X=Nm/N  is  the  ratio  of  the  number  of  modifiable  cells  to  the  total  number  of  cells  in 
the  network.  This  yields 

Xi*=  a  (1  -  Xa)4zr.  [361 

That  is,  the  asymptotic  state  of  the  closed  eye  synapses  is  a  scaled  function  of  the  mean- 
field  due  to  non-modifiable  (inhibitory)  cortical  cells.  The  scale  of  this  state  is  set  not  only 
by  the  proportion  of  non-modifiable  cells,  but  in  addition,  by  the  averaged  intracortical 
synaptic  strength  L. 
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Thus  contrasted  with  the  mean  field  :•  10  theory  the  deprived  eye  LGN-conical  synapses  do 
not  go  to  zero.  Rather  they  approach  the  constant  value  dependent  on  the  average  inhibition 
produced  by  the  non-modifiable  cells  in  such  a  way  that  the  asymptotic  output  of  the 
cortical  cell  is  zero  (it  cannot  be  driven  by  the  deprived  eye).  However  lessening  the  effect 
of  inhibitory  synapses  (e.g.  by  application  of  bicuculine)  reduces  the  magnitude  of  a  so 
that  one  could  once  more  obtain  a  response  from  the  deprived  eye. 

Discussion 

Having  defined  a  mean  field  approximation  that  greatly  simplifies  the  equations  for  the 
response  and  evolution  of  cortical  cells,  we  have  obtained  a  fundamental  result:  the  stability 
and  position  of  the  fixed  points  in  this  network  are  related  to  the  fixed  points  in  the  absence 
of  mean  field  (a’W  =  0)  by 

m  *(a)  =  m  *( 0)  +  a ,  [37] 

where  m  *(a)  is  a  fixed  point  of  Eq.  22  in  the  mean  field  a,  while  m  * (0)  is  a  fixed  point 
of  this  equation  of  zero  mean  field. 


Thus  if  m  *(a)  is  restricted  to  the  first  quadrant  (positive  values  for  all  of  its  components 
due  to  the  excitatory  nature  of  LGN-cortical  synapses),  as  long  as  a  is  large  enough  and 
non-specific  (there  is  sufficient  inhibition  for  all  pattern  inputs),  ni{(a)  can  still  reach  all  of 
the  fixed  points  that  would  have  been  reached  by  m^O)  (not  restricted  to  the  first 
quadrant.)  This  means  that  if  network  inhibition  is  sufficient,  the  selective  stable  fixed 
points  can  be  reached  even  though  LGN-cortical  synapses  are  excitatory.  Once  reached, 
the  fixed  points,  m\  (a),  have  the  same  stability  characteristics  as  the  corresponding 
m;*(0). 

We  find,  consistent  with  previous  theory  and  with  experiment,  that  most  learning  can  occur 
in  the  LGN-cortical  synapses;  inhibitory  (cortico-cortical)  synapses  need  not  modify. 

Some  non-modifiable  LGN-cortical  synapses  are  required.  It  becomes  interesting  to  ask 
whether  these  could  be  associated  with  some  anatomical  feature  (e.g.  might  these  be 
synapses  into  shafts  rather  than  spines). 
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activity  (depending  on  the  level  of  inhibition).  Some  'non-visual'  cells  would  reappear  if 
excitation  were  enhanced  or  inhibition  diminished. 

In  monocular  deprivation  the  closed  eye  response  goes  to 


c  =  (x  -  cc)  •  d  — >  0 


[38] 
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Therefore,  LGN  -  cortical  synapses  do  not  go  to  zero.  Rather 


x  — >  a. 


[39] 


Thus  if  inhibition  is  suppressed  one  would  expect  some  response  from  the  c.  ised  eye. 

This  is  in  agreement  with  experiment. 

Various  models  for  memory  storage  and  retrieval  have  been  suggested.  These  differ  in 
several  ways.  One  of  the  most  important  from  the  point  of  view  of  computational 
complexity  as  well  as  for  realization  in  silicon  is  the  degree  of  connectivity  of  each  unit. 
What  is  suggested  here  is  that  much  that  is  significant  in  at  least  one  layer  of  visual  cortex 
can  be  obtained  in  a  primarily  feed  forward  network  of  very  simplified  lateral  connectivity. 
The  original  connectivity  in  which  each  of  the  N  neurons  in  this  layer  of  cortex  is  connected 
to  every  other  [N2connectivity]  can  be  replaced  by  a  mean  field  network  in  which  a  neuron 
receives  n  LGN  inputs  and  a  single  (mean  field)  input  [(n+1)  connectivity]. 
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Footnotes 


*  If  we  expand  ( 1  -L)  ~ 1 ,  w'e  obtain 


(1-L)'^  1  +L  +  L2  +  ..„ 


an  expansion  in  mono,  di,  tri  ...  synaptic  events.  How  many  synaptic  events  one  includes 
depends  on  the  time  interval  of  importance.  For  synaptic  modification  we  assume  that  time 
intervals  of  the  order  of  a  half  second  are  appropriate  Thus  c  represents  the  average  over 
about  one-half  second  of  the  number  of  spikes  of  that  are  the  result  of  an  external 
presentation  (ll).  The  post  stimulus  time  h:'  .ogram  can  be  broken  into  much  smaller  time 
intervals  thus  separating  mono,  di,  tri  synaptic  events  and  excitatory  and  inhibitory 


synapses. 


t  The  average  magnitude  of  cortico-cortical  inhibition,  Lo,  must  be  smaller  than  one. 
Otherwise  c  would  be  smaller  than  zero  (Eq.  7a).  There  would  be  so  much  inhibition  that 
on  averace  no  cells  would  fire. 


+  For  simplicity  we  oftc  ’  compute  q  as  an  average  over  the  environment  (d^...  d^}. 
Thus  ,  for  example,  for  the  monocular  case,  at  a  selective  fixed  point 


(mi  -  a  )•  d  1  =  0M 


(preferred  input) 


(mj  -  a  )•  di—  0  (j>l ,  non-preferred  inputs), 


so  that 


c,  =  ttX  (m,  - a  )■  d  J  = 


With  the  definition 


0M  =  <q ): 


>e  obtain 


<-V"  K 


so  that 


0M  -  K- 
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independent  of  the  mean  field,  a  . 
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Appendix 

Asymptotic  Behavior  of  Mean  Field  Equations  with  Time  Dependent  Mean 
Field 

From  Eqs.  19  and  23,  the  trajectory  of  the  corresponding  point  is 


Using  Eq.  18,  we  have 

so  that 


rh[  =  4>  [m(]d  -  Ct 
(x=  a  m(a)  =  a  (1  -  d)Am' , 
w,'  =  6  {/Mj'jti  -  a  (1  -  a ybri  '. 


[Al] 

[A2] 

[A3] 


At  the  fixed  points  th (  =  0.  When  all  of  the  cells  of  the  network  have  reached  their 

respective  fixed  points  m\  -  0  for  each  cell.  Therefore,  ni  =  0.  It  follows  that  when  the 
network  has  stabilized  at  a  global  fixed  point 

<>  [m\]d  =  0  [A4] 


for  all  inputs.  This  is  the  same  condition  as  the  a-  0  (adiabatic)  case.  Thus  the  position 
and  stability  of  the  fixed  points  are  the  same  as  those  in  the  adiabatic  theory.  However, 
since  0<(  1  -a)<  1 ,  the  absolute  value  of  average  movement  of  the  entire  network  towards 
the  fixed  points 


|/zT|  -  ( 1  -  a )  OU/i,j.,' 


I A  5 1 


is  slower  than  in  the  adiabatic  theory. 
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